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EXECU'kVE S UMMAR Y 



PRbjECT PURPOSE AKD OBJECTIVES 



In May>'l974f E. F. Shelley and Company, Inc, was awarded MA/OPER , 
Contract No. 20-36-74-22 on a competitive- bid pursuant to RfP 
MA/oper 7411* The purpose of thV^p'roject was to develop methods 
N^or esta"bli3hing and using' perFbfmahce standards for the job 
'placement and support functions of the public Emplo^/^ment Service 
system -(E^) , as , the first phase in a research and developmental , 
program, ^s stated in the^ original request for proposals; 

The primary objective of the demonstration project is 
to develop Valid performance standards for Job Place- 
ment activities anO^the Placement Suppott Service func- 
^ tioris* These standards will be used to reflect the 
effectiveness and, the efficiency levels at ,which the * ^ 
various placement and' support functions of the eS should ' 
be performed with consideration ^o both quantil^y and ^ 
quality;, to design a feasible ^stem of methods and 
procedures for using such measures to assess the^perfcSr- 
mance of state agencies in performing activiti.es rela- 
tive to the standards r arid to design a system for the ^ 
-periodic Revalidation of the standards » 

The original project objectives were implemented by a plan to 
demonstrate the feasibility of developing valid performance stan- 
dards through design of a model system, field data * collection and 
analysis, |>reparation of a handbopk documenting the methods and 
techniques, ahd preparation df a final repott* Dmring the design * 
please of the pr9ject, it became clear that autput performance stan- 
dards to be used in plaftninq, budgeting andlevaluatii^t' muSt be' 
developed independently from and. p^ior to tWe development of input 
performance standards to be us6d a$^ diagr\osl:rc tools* Therefore, 
the scope of work\was expanded in August , \1974 , to include research 
into the Balanced Placement Formula (BPF) , an empitically^derived 
per formance-based' budgeting system using national averages as th^ 
key standards of output performance » The objectives ot the expan- 
sion were to identify internal wea)cness^s of the BP? that might • 
cause inequities or permit manipulation, to identify external en- 
vironmental factcfrs that affect ES performance, and to test alter- 
nate formulations or suggested revisions ii\ the BPF' through a 
simulation model* The short-run purpose was to perform analyses 
in' support of revisions to the BPP for use in FY 1976 funding 
allocations; the long-ryin purpose was to develop a model system 
for isetting output standards for state and •local ES operations 
tha,t takfe into account the effects of environmental contraints on 
ES placement functions » 

%n its final* form, the scope of the project encompassed two of* the ^ 
'Presidential Objectives for the United States Employment Service 
^and, consequently, ,was the subject of brdad interest throughout 



The Manpower Administration. While attempting to demonstrate the ^ 
feaSibili^ty of applying innovative methods to ES planning, budget- 
ing, ^valuat^ion and diagnosis, the project was also required to 
develop immediate , short-run /applications of some of the pew and 
complex techniques to on-goi^ig . problems and needs* 'fhe result ^ 
of this ■pi'oductive ^tension Was that the methods developed " for es- ^ 
tablishin<5 hnd using ES outj^ut and input standards ft>cus on speci- 
fic applications that are feasil^le to implement within the next 12 
months, using existing sec6ndary data sources and standard statis- 
tical methods for setting output standards, and using minimi^ P^^^"" 
'mary data collection and analysis for settling input standards ^ 
The Methodology Guide , Volume .3 of the Final Repprt, presents the,, 
methods ih^detail* & ^ * 



PROJECT ACCOMPLISHMENTS AND LIMITATIONS 

A * Accomp 1 i^Iiments 

1* "Feasible Methods for Establishing and Using Output 
Standards 

The project Has defined key ES output, performance 
indicators and environmental factors,, tested methods .for 
establishing output standards for these indicators and 
developed methods usiirg^ output standards f6r performance, 
evaluation and funding aJlcJcations.. 'A by-product is a 

* ' performance projection method » 

... --..^ ■* , , 

a> Definitions 

Output standards shquld be established at the labor 
area level, because the labor area or SMSA is an in- 
tfegra^:ed social and^econoihig system constituting the 
ej]j^ronmerit within which the ES placement and place- 
ip^t ^support services are provided. 

'Given availJtble data soprces ^nd the current level 
■ af conceptualization, it- is possible. to set an output 
standard that is an expected. Average level of perfpr- 
^mance based on thfe aye::5age performance of siipila^ labo 
areas, and attainable by management of average*"^uality 
taking into account external social and economic fac- 
■ ^ tors and internal policy, law, and resource factors, 

for each of the' 150 majoi: labdt^areas and 48 baflance- 
of-state aVeas. \ * . 

T 

S^:andards must be set for each labor area fc^r feach 
^ . performance indicator" i3sed in performance evaluation ✓ 

or budgeting. Three^ measures of ES performance re--^ 
commended for use a^ the key performance indicators 
were selected becaul^ t&fey not significantly 



1 



affected by statue or loca^ policy With respect to , ^ 
applicant registration or job order taking, the data 
can^ be verified, and they represent key aspects of 
the labor exchange function. They are: 

(1) Productivity:, Individuals placed per 

man^year worked. ^ 

* ^ (2) Service" to the Labor Markfet: Individual's" 
* . placed as a perpent of the.ntamber of un^ 
elaployed individuals. 

(3) Service to the Job Market: Job openings " 
filled as a percent of non-agricultural 
wage and salary employment. ' 

Indicators (2) and (3) are combinatipns of more tra- 
ditional measures* ^ V 

The^e 3. indicators capture the "quantitative" aspect^ 
of ES output performance; for uses requiring "qualita- 
tive" measures, *such as percent" of veterans placed/ etc. 
an algorithum was develope,d to derive standards for 
qualitative measures in a way that encourages balanced 
performance relative to national objectives witKout en- 
couraging data manipulation* . 

The ^relationships between environmental factoVs and ES 
per'formance are suffigiently complex to require a tabl^ 
of hypotheses, not all of which were tested during the 
project. ^Because additional analysis and testing is re- 
quired/ the environmental factors found significant in 
'previous analysis are merely listed here: 

^ * " . ' / ^ * ! 

(1) Staflile external factorJ^^ 

Industry "Composition " '^"^ ^ . 

^ Labor Pprce Composition ^ ^ ^ - 

m Size of Area (employmetnt and unemployrtient)- 

(2) Volatile external factors 

« Growth rate . , 

m ' Unemployment rate * , 

(3) Intejmal Environment factors 

^' • Policy and law, especially registration of 
^ UI claimants 

^ . r ^ ' . . 

• Resources (man-ye^s) 

7 C ' . ■ 
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Statistical analyses conducted duting the project in- * 
I dicate^that these factors, in combination, account for 
up to 70 percent of tlie differences in .performance 
^ * ' among states and labor areas, even though the ^arj^lVses 

* ' \ * did not thoroughly test all hypotheses* The con^lu-^ ^ 

- sion is that environmental factors^ have a major, if ^ 

* not dominant, effect on ES performance* 

b* Methods for establishing output standards, ^ 

t * 

;rwo alternate methbds were developed for establishing 
output standards at the labor area level that take into 
I account environment^al factors » One method uses multi- ^ 

pie regression analysis to produce an estimating equa- 
tion for setting an output standard for each key per- 
formance iitdicator for each labor area. *The equation 
indicates how much the performance indicator iis ex- 
pected to 'increase (or'decrease) as a result of a one- 
point increase in each external factor, based 
^ implicitly on the average of all labor' areas* The 

equation can be used to compute an expected value, or 

1 output standard, tor each specific area* Test results 

\ ' * * w^re pjroduced; 

The second method uses the "environmental factors to 
develop a typology of l^bor a^eas and to group labor 
areas by type.. Within each such group, the output 
standard is based on the avei^age of all areas within 
_ , "the t^pe, and each area within each type ha^ the same 

^ standard for each key performance indicator* No tests 

were made of this method. 

The choice^ between the two methods depends primarily on 
politica]i> consideration, i.e, / which method yielda re-- 
suits that have the greater face validit^^ to ES admin- 
istrators and which appears to be fairer* Oh technical 

* grounds alone, the estimating equation is preferred/.; 
Both methods yiel^ output standards that should be at- 
tainable by management' of average qilality, ^nd they have 
known standard errors which can be used to set '"standards 
of excellent f>erf ormance" or a "minimum acceptable level 

' of peirf ormance" > both of which may be desirable^ for cer- 
tain uses. Both methods can be used to set output stan- 
dards for qualitative performance indicators; and both 

^ can be used* to set standards for s\ib-f3arts pf labor areas, 
.needed for evaluation and funding allocation purposes 
especially in labor areas that cross state lines* 

c. ' Using output ' standards . , 

Output standalrds ^ind the model system by which they are 
established havets^several useS^ As a •management' tool. 



<;cipmparison of actual perfdrmance against the standard 
identifies individual areas within a state that. are 
significantly ab6ve or below *the standard, and helps 
to identify priority areas inf&/hich idiagnostic tools 
should be applied* to improve .fSbrformance » 

As a funding allocation tpol, the- project develgped 
methods whereby the output standards carv replace the 
national averages , used ^in past SPF*s* A labor area 
scbre is computed for each indicator by dividing the 
standard into , the Actual E^^rformance , i^e^f the ratio 
*bf actual to ^standard^ The state scare for each per- 
lormarfce indicator .is computed as the weighted sum of 
the individual labor area scores* The ^tate summary 
score comparable to previous BPF scores is computed 
as a weighted average of the State . scores for ^ach in-^ , 
<?dicatbr , iiwhere the weights are analogous to the budget 
weights used in previous BPP' s/ This summary score ^ 
would be; 100 for- a static vd-tb ayerage performance, with 
better-performing stdl^es having a higher score*^ * * - 

* . ' » 

A similar method could be used by A state, for alloca- ^ 
ting fund^ among labor areas within a st^te, if the 
istate chose*" to do so* There is^ however, an important 
limitation: the results do npt, apply directly to in- - 
dividual local offices within a labor are^, nor, mdre 
* importantly, to individual areas outside the 150 
ma^jor labor areas because data on external factors are 
not available from published sources for s^JLph areas * 
Each such office or area must.T?e ^evaluated individually 
by/ stat.e management » 

Toward a dynamic model 

■ ^ ' / 

The preceding* methodology will result in a static 
model -which calculates expected ES performance baseS 
on total performance for the yfear (or othe^ time per- 
iod) and the. average bf "^external factors for. the same 
period* Such a model is quite ufeeful for a variety 
of purposes, but it cannot fully reflect the real world, 
in which ^events occur in a time continuum and in which 
current. ES performance is a function not only of cur- 
rent ^conditions but also of*rec^nt history* l4i the 
real world', use of annual data may obscure time-'dependent 
relationships between ES E)erformance and externa^ factors 
if the impact of a change in external factors such as 
rapidly rising unemployment passes within' one or two 
quarters* Th[e. effects can plainly be seep by an obser- 
ver in any ES office, but may wash out in annual averages 

The purpose of a dynamic model, then, is to provide a 
fraipework reflecting the instantaneous and time-lagged 
effects of cyclical variations in external factors on 
ES performance, and in particular on .itidividuals placed 




par man-year*. To develop the model, it' is necefesa^y to 
explore these intertempo3:al cyclical relationships, 
adjusted for^seasonai factors and for var*i^tionS'^aused 
by the structure of the-ESARS reporting system* 

Quarterly t;S performance data are affected ^^^dth^by tru^. 
seasonal factors and - by artifacts of the reporting 
systems* ESARS is a cumul^^ve reporting system, which 
couijts each .indrvidua^l place<| (IP) only once'du^ng tlie 
fiscal year, ho matter how many times the individual is 
placed* The 'annual ratio of transactions (P) to indi- ' 
viduals is about 1*5* It appears that approximately 
75 percent of th^ jtndividuals placed more 'than once dur- 
ing a fiscal ye^r, .usually in casual,' day worker, or* 

nt 

a,nd tne cumulative total of individuals plapQd/ye&<r*€a- 
da^te will rise, estimates of the net nmt^lheV* of new 
individuals placed will a^lways sJ^ow a qtfartej:-to-quartier 
decline* ' ^ * ' ' ' 

Unfortuniat^ly , there^ does not appear to b^ a simple ; 
method for estimating the quarterly effects of th^ 're-^' 
orting system in isolation from seasonal or cyclical* ^ 
ari^ations* - \ / V 

A dynamic model would r&pr^sent a very significant etdp* 
forward in" refining the ES management s^ystem: Some q£ ^ 
the^dynamic effects of cyclical change on ES performance 
might ultimately be reflected in the annual ^funding 
allocatior^ process, insofar as the data ^on external " :^c- 
tors found relevant are available shortly after the con- 
clusion of each quarter* Thesfe effects could also 
reflected in specific resource retjuirement and perfor-, 
mance pi^ojectidns which are a part, of the annual budget- 
ing process* Given th^ current needs for further develop 
ment of'tfee static model hpwever , it is not recommended 
th^ substantial resources be devoted to deyelopm^nt of 
^ dynamic tnodel* 



Feasible methods for establishing ^nd using input standards 

The project has jdeveloped practical definitions of ^standards- 
for placement and placement support activities of the ES 
local office, efficient methods for tKe data collection and 
analysis needed to establi^sh initial input standards; and 
guidelines for establishing input , standards. 



a. Definitions ' ^ 

^Input standards are models, mea^sure& ^and comparisons 
wheiJeby^ a local ES manager can con\paire his^patteirn of. 



resource utilization, with the standard for hi's type 
, local axea. Through ' review of the ES Maj:>ua'l , hand- 
'boofes, aftd.ih^ consultation with national,- r:egional| 

state, andi'l^cal 'ES ^tWff,- 13 placement, and placement 
^^iipport^a'cjtivities were? defined, and through field ^ 

w6jJt''9 categories Df .nOn-placement ,time were i'dentified, 

as fo'llqwsi . , • ^ ' 

Placement "^and 'Support Actiyitie^ ^ > . ■■ 

r -. ■' ■ \ . ' ■'■ ■ . 

AT APPLICATION TAKING • ' ' • 

/ CS COMMUNIXY SERVICE' • 

CO' Counselling ; ; ' ■ ' - ,. 

ES employer SERVICE; ' ' c ^ 

■ FC "PILE SEARCH/CALL 1*3 . • , * 

„ , Jb . ' JOB DEVElioPMENT 

JIS JOB INFORMATION TAKING 

-JO JQB ORDER TAKING 

RE , RECEPTION 

RC • REFERRAL CONTROL"^ ' ^ V 

RI "REFERRAL INTERVIEWING . ' ^ 

TE TESTING - . ' . ' 

V^ ■ -VERIFICATION/VALICMiTION 

* ^ * m ' m , f • * ' 

Non-Placepient Activities ■ , 

XC CETA .■ . ■ " ' 

XE, -EFS S^DY- - , -\ . ^ ■ 

'XfI • . CLERICM^ 

■ XI N SICK ' , . ■ . 

XJ "fJOB CORPS, FOOD STAMP^ UI, ETC. ■ 
" XM KEEPING, TRAINING 

XS SU^R,, MANAGEMENT, ETC, 

■ XV VACATION, . ANNUAL LEAVE- . ' 

XX - PERSONAL, COFFSE BREAK, ;iLL ELSE ' 

Whfen established, there "wduM be four types of st^dards 
^percent of resources devoted' to each activity , service 
' ratios, efficiency measure^^ and key quality factors', • 

J^pthods of data collection and analysis 

During the initial field work ^ stage of thfe project, 
specific data collection instruments were tested, 
The^key instruments are the frime ladder, on ^which e'ach 
staff meitiber record;s time utilization by function in 
S^minute intervals and number of peersons sejrved,, and. 
the' key quiaity factor questionnaires for each of the 
functional activities , Subsequently, these instrume.nts 
j^ere packaged with instructions, arid a field test 
^demonstrated the feasibility of local staff usingthem 
in a self ^application mode ^wlth no contractor assistance 
and with minimal assistance from a -trained person from 



the stat^* 



fter completing the ,f"i,eld work and initial data i 
alysis, techniques were developed for future us| at 
e local office level to simplify ..centrefT- data analy- 
is^ and to incorporate local cross-validation at the 
source datfe collection point*/ This, will, save on analy- 
sis and error correctiorv at the centrals point * ) 



Establishing input star^dards * ^ 

The. ideal objective of the next major phase of input 
st^dards development would be to establish and^'vali-/' 
date patteijQS of resource use, service ratios, and 
efficiency and key quality factors /that discriminate - 
betv/€?fen areao having higlj levels of dut^fUjf performance 
(under, given .sets of external ^conditional and all 
other areas* 'However, the* current stdtO'^f-the-art^. 
doe^ not permit the *'valid&tion*'^of inpulHstandardg 
ValidatiopJ df standards requires thfe analysis of in- 
put patterns in relatiog^tiip to output peirf otmanc;e , 
and the identif icatibn 6f^input patterns^^at discrim- 
inate between . high performers' and , low' performers , - - 
holding all otheV factopS .^constant* " ^ 

The UpSe of output standards and the cpmparisoh of * 
actual performaiice with the standards' perm^^ts identi- 
fication of high andVlow performing labor area^,^hold- ■ 
ing constant -the effe^cts of external economic and 
policy fact03;^s» To validate iriput standards addijtional 
factors must be held- constant; local office lopatiop, 
overall management quality, staff skill level .and \" 
morale^ and qiJite possibly the mix of applicants ' and . 
job openings » This would" permit , the obs^ved ^a^terns 
of inputs to be tested, net of ail other^^f luences , 
to identify those patterns which 'di^crii^iate .betvi^len, 
high, and low perjfbrmers- Wtiile technique^ have b^en 
developed for ^rteaguring^ location an<5 manag^ent quality, 
they have not, been sufficiently testjed and integrated, 
into a comprehensive system to permit us to fajclior 
them into an arta lysis in the" inunediate futujre* 

Therefore, an achievable short-rtin obj^ctiye is, to 
identify patterns of input ut^iz^ionr characteristic 
of high p^r^orming labor areas and of offices within 
those areas, ignoring the otheir, internal factors arid 
deferring the question of validation to a future time 
when the state-Qf'1;^he-art permits Validatibn* The^ 
steps needed to achieve the objective include mea^ure- 
ing input utilisation in a sample l^E>or ^reas,. \ 
i^dentifying input patterns, and prfeparih^ input guide- 
lines for different types of- lat>or axea^s/ 



^ (1) Sample of ^reas ^ 

The sampling plan developed^ in ther5)roje'ct , 
uses the output standards methods ito identify 
high performing areas, i*e», thoa^ whose ac- 
tual performance is at least one/standard 
deviation higher than their sta;|dard, and uses 
! the environmental factors to gr^iup areas into 
, discrete types- The. 12 largfe^^ SMSA^s are 

excluded from the sample, because their si2:e" 
. ap^ complexp-ty requires a separate stratified 
i^ig^mpling plan to select r^,pi;^sentative offices' 
^ " within them, and becaiise th!|ir size alc?ne in- 
\ dicates that th^y should be ^studied , iri^^spec- 
tive of output p6rformance> Thfe plan/ results 
. in, a sam5)le of 23 higfi-perf ormirig laj^or 
areas plus 8 balance-of-state areas* ^It is 
estimated that the Sample would contain about 
loo local offices and 2,000 staff* 

' ' . \ ^ \ 

(2) Copiputafejion e^input standards . I , 

r^y ^ The data collected frbm the sample of labor 
areas will be used to compile the fbur types 
of input measures for each of the 1*3 ftinctibnal 
, activities and non-placement time for each 
of the 31 (^ample areas , using the detailed 
methods c&ntained in the HandbOQk fo^ "Analyzing 
^ Local ES Performance* Tlfe r^JUlt wi 11 'be 31 
sets of input metf&ures* 

Th^ data for tlM^reas^ would be grouped by 
type of area" - 5 or & SMSA types and-l balance- 



of--state type* \To calculate the input stetndard 
for each'^type ofSJ.abor\area requires two 
related computati^s* JThe first step is to 
calculate the aver^ge^cross areas within each 
type for each of the inj^ut measures, minutes 
' per unit, sejrvice percents , percent of resources, 
and key quality factors* ;(0f these, orrly the 
percent of resources is relevant to non-place* 
ment time*) The average for each measure is the 
initial input standard for feach ES function. 
The second step 4-S fco compute the standard. . 
deviation for each ot the measures* The stan- 
"dard deviation will be published along with the 
.average to indicate the extent of variation ob- 
served* ' 



Us4s of End ProductJs 
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In preparing a report on a demonstration project designed to* develop 
roajor, new systems approaches to the evaluation, management and funding 



allocations for a "national service delivery system such as the 
Employment Service, the researcher tends to overstate either the^ 
strengths. of the end products, or their limitations, or as io 
the j)resent caise, bbth\ It may be useful, therefore, to s\iinmarize 
for decision-makers " the ' size .^nd shape of the foresi and the gen- 
eral quality of some of its major sections without Regard to the 
■strengths or , weaknesses of individual trees* 

* 

A, ■ Output Standards ^ ^ 
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It is clear that the methods developed (and future refinements 
th^rfeof) "can be used to establish performance star>dards for 
placements and placement-related outputs that takdl into accountV 
the net effects of external and internal environmental factors ; 
On an annual, cross-sectional basis and that should be attain- 
able ^by mana^gement of average quality* The refinenfents recom- 
mended in th^ report may clarify how the effects operate on f^if-* 
ferent parts of the labor exchange" process and how intertemporal, 
variations in external factors impact the'ES* They may even re- 
sult" in the capability to explain up to 90 percent of the^ dif- 
ferences .in performance among areas, as compared with up to 70 
percent explained in tfie present project, with the combined ef- 
fects of broader data coverage and refinements in the specif i-'^ 
cation of .external factors and the estimating method* 

\ 

The key question even prior to undertaking further refine- 
ments, is what should the output standards be used for^and, 
conversely, what should they not be used for? Such stan^iards 
Can readily bfe used as"ar tool for evaluating the overalr^ 
quality of management* If ES performance in -a'given aree^ is 
significantly below the standard which takes into account the 
net effects of all environmental factors, there is a prima 
facie case that "overall management is below par* If man/ areas 
within a state have performance below standard, then the proces^ 
of ^ diagnosing the causes of poor performance should begin at" 
the state level, with a review of management Systems , training 
approaches, sta*ffing methods,, etc. At the labor'area level, , 
the .location of offices, staff assignments, and th>e^6verall ■ i 
manner in which staff respurcfes are organized, trained and man- 
aged should be examined. This evaluation is, conceptually," part 
of* the^ self **appraisal process. The model or system for estab- 
lishing output standaras should also be , used to estimate ES 
performance, particularly in response ^jbo small increments (or 
decrements) of resources* Used in this way, it becomes a simu- 
lation model, wherein the equations used to set the output 
standards can be multiii)li!ted by the marginal increment "Of re- 
sources to yield estimates^ of additional placements artd-^g^^e- . 
ment-r^lated outputs* 

In relation to the annual funding allocation process, the re- 
port describes in detail the rationale and methods for using 
output standards adjusted fo^ ex^rntfl ^environmental factors 
in lieu of national averages in the perf Ormance-based budgeting 
system* ^ ^ 



10 



The interpretation o§ the* research results Is that certain 
states having average management capability can reasonably be 
expected to ha,ve performance levels -it least twice as high a^ 
certain other states also having average management capabililgy^ 
Tl^e credibility of the research results lias been challenged^ 
> because on-site evaluations have identified numerous examples 
o| poor .management practices in certain area^, where tl^e statis?^ 
tical analysis results indicate that actual performance is eqq4y 
to or better tha^ the (low) standard; the conyerse. is also trlSe* 
One hypothesis (not easily testablel is that the en>>ironment in 
certain areas is feo detrimental to ES performance as to produce 
organizational frustration , manifested as poor management: , low 
morale^ etc* This leaves the policy-maker with scpething of 
a dilemma: i 

On the one haind, it is desirable to reward goOa^manage- 
ment^ implyirl^ that the absolute level of performance i-s 
not being judged, only actual performance relative to a ^ 
reasopable standard » This approach is advantageous / 
particularly when in the past it has been the large 
northern and! eastern states who have suffered most through 
BPF* If the! standards are lower for sux:h states, it is 
less likely [that tjiey will suffer cuts in the future* 

On the -xbther hand, the ES exists to serye job se^kers^ ' 
and employers who request its services* Irrespective 
of the quality of management or the stability of the 
sieryice orgknization, it seems reasonable to, allocate 
the resources to states where the greatest number of 
clients can be served* It is often argued that resource 
reallocations through the BPF have in some ^ense penfal- 
ized the people living in the states losing resources » 

The converge of this argument is that leaving resources 
in^^ates where actual or expected productivity is low/ 
(irr&spect^Lve of^^ quality of management) penalizes the/ 
res^?^nts of states where productivity is high. For | 
exaipple, a state whose prof3iictivity is 200 individuals^^ 
pUfc^^ed per man-year can se'arve twice as many p^^le peri? 
unit of resource as a state whose productivity \is only 
100*. Job seekers in the first state lo&e dn thW^atio 
of 2 to 1 when (marginal) resources are reallocajted to 
the second State* . 

The policy^maker must address this dilemma^ taking intp account 
both the political and. the program implications of different 
solutions^ prior to deciding how the adjusted output stai)dards 
should enter into the tunding allocation process, if at all> , 

It is recommended that two somewhat different streams of activity 
,be undertaken: to further develop and refine the output stan- 
dardg model system, and td refine the performance-based budget- 
ing system (BPF) * 

' V 11 
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The major objective for refining the output stan4ards model 
would be to define a complete system of. structural equations 
describing the response of the ES system to environmental fac- 
tors, starting with a simple model thajt describes " net respbnses 
and building toward a causal model, H secondary objective 
would be developnent of dynamic modal reflecting intertemporal 
processes , ^ ^ . ' . ^ 

To. refine the p^rf ormance^based budg^ing system req^uires pri- 
\ ' marily a system for taking (simulated) results dt output 'stan- 
' dards from the mQdel„ simulating- funding alloc.ations that would 

result from diff^ent policy scenarios, and presenting the re- 
^ * suits in summary form to ^decision-^makers. 

Although the twq^streams of activity are close ty ' related , the 
first is research-intensive while the* second is poLicy-intenSive ; 
unless, adeqaft,tely separated, there may be too much competition 
between the £wo for scared professiORal resources, ' 

B, ' Input Standards • * , ■ • 

The methods and techniques for establishing initial input stan- 
dard^ were advanced to a much greater .level of detail during the 
pnoject, and in particular the feasibility of efficiently col- 
lecting and anr^lyzing dat^ on input utilization patterns was , 
demonstrated , It is f easib le to establish initial input stan- 
* dards, characteristic of the observed pattern^ in h^h-perform- 

ing off'ices of each ti;pe. The initial standards would be/* 
^ limited, however, because they could not be validated due to the 

lack of an integrated system for measuring the effects on 
organization and performance of prior causal factors endogenous 
to the ES systeip (i,e., direct measures of the quality of man- 
agement, the effects of office location, etc) nor could the 
standards be fully applied to loc^l officers within laboi? areas. 

The benetit^^yof having models and measures 'agairust whi^ch local 
ES mar^^el*^ /^^n compare their input patterns' must be offset 
against the potential costs of misusing such standards to 
dictate patterns to local managers, a la the now-defunct work- 
load/time factors. Even valjidated input standards can only be 
used as one diagnostic tool available to ES management in 
developing performance improvement plans , State and local man- 
agement must ultimately make judgements on how best to' meet per- , 
formance objectives in each labor area^ drawing upon all avail- 
able diagnostic tools but using none in a lockstep, cookbook 
marine r; - ' ' ' ' 

. The decision-maker must weigh all costs against the benefits 
beforfe deciding to prooeed with the data collection and analysis 
required to establish initial inPut standards* 

There are two additional uses of the instruments, methods and 
techniques in the Handbook for Analyzing Local ES Performance 
that could be pursued, even if it were decided to delay im- 
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^ plementation of initial standards* The first use is as a . * 

^ local assessment tool, where the results of a locally- initiated 
data collection and ^nal^sis effort could be compared with in- 
^ ternal standards (such as the Plan of Service , local annual 

bbdget, or even the imj^li'fcit, experimental standard of Cogni- 
zant ES managers) . While the standaxd of comparj-son would not 
be overly rigorous or^precise, the local ^^janag^r would gain an 
accurate picture of how staff resources are applied, etc. • 

Second, the rsjsults^ of conroarisons of time utilization statis- ^ 
tics compiled from time^ ladders completed during the field work 
for the prcJject with cost-accounting . system time-distribution 
sheets showed signifipant discrepancies, not so jnuch in total time,' 
but in the allocation of time among functional activities and be- 
tween placement and non-placement activities.. The* results cpn- 
firm th^ assertion that the official time distribution system 
* does not (and possibly cannot) , accurately measurers staff utili- 
zation by function. It. might he decided that the ES should U3e ■ 
' ^j; 'a time ladder instrument quarterly (one week per quarter) in A 
sample of labor areas to olitain accurate estimates of the al- 
location of st^f time by function. 

C. ^ Conclusion ' - 

In undertaking this project to develop performance- standards 
for job placemenjb and placement-support functions, the Depart- 
ment of Labor Manpower Administration has initiated the first 
^hase of a program that can substantially advance the state-of- \ * 
the^art in systems for funding and managing the United States 
Employment Serv^ice system* The prese/it project has defined 
second-phase approaches that ai?^ £^e?asibife for inrplementation 
ip the next year. Because some of the techniques are complex 
and new in this application, an ^important need is to develop 
ancillary training and development" programs at all levels, to 
permit managers and administrators both to shape and to utilize 
practical results as the prografA moves' through each ph&se. 
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